Path to Stochastic Stability: Comparative Analysis of Stochastic Learning Dynamics in Games
نویسندگان
چکیده
Stochastic stability is a popular solution concept for stochastic learning dynamics in games. However, a critical limitation of this solution concept is its inability to distinguish between different learning rules that lead to the same steadystate behavior. We address this limitation for the first time and develop a framework for the comparative analysis of stochastic learning dynamics with different update rules but same steadystate behavior. We present the framework in the context of two learning dynamics: Log-Linear Learning (LLL) and Metropolis Learning (ML). Although both of these dynamics have the same stochastically stable states, LLL and ML correspond to different behavioral models for decision making. Moreover, we demonstrate through an example setup of sensor coverage game that for each of these dynamics, the paths to stochastically stable states exhibit distinctive behaviors. Therefore, we propose multiple criteria to analyze and quantify the differences in the short and medium run behavior of stochastic learning dynamics. We derive and compare upper bounds on the expected hitting time to the set of Nash equilibria for both LLL and ML. For the medium to long-run behavior, we identify a set of tools from the theory of perturbed Markov chains that result in a hierarchical decomposition of the state space into collections of states called cycles. We compare LLL and ML based on the proposed criteria and develop invaluable insights into the comparative behavior of the two dynamics.
منابع مشابه
Comparative Analysis of Stochastic Frontier Partially non-parametric and Stochastic Frontier Parametric Methods Case Study: Measuring Cost Efficiency in Wheat Production in Iran
متن کامل
Dynamical Analysis of Yeast Cell Cycle Using a Stochastic Markov Model
Introduction: The cell cycle network is responsible of control, growth and proliferation of cells. The relationship between the cell cycle network and cancer emergence, and the complex reciprocal interactions between genes/proteins calls for computational models to analyze this regulatory network. Ample experimental data confirm the existence of random behaviors in the interactions between gene...
متن کاملDynamical Analysis of Yeast Cell Cycle Using a Stochastic Markov Model
Introduction: The cell cycle network is responsible of control, growth and proliferation of cells. The relationship between the cell cycle network and cancer emergence, and the complex reciprocal interactions between genes/proteins calls for computational models to analyze this regulatory network. Ample experimental data confirm the existence of random behaviors in the interactions between gene...
متن کاملComparative Study of Random Matrices Capability in Uncertainty Detection of Pier’s Dynamics
Because of random nature of many dependent variables in coastal engineering, treatment of effective parameters is generally associated with uncertainty. Numerical models are often used for dynamic analysis of complex structures, including mechanical systems. Furthermore, deterministic models are not sufficient for exact anticipation of structure’s dynamic response, but probabilistic models...
متن کاملMonetary and Fiscal Policy Interaction in Iran: A Dynamic Stochastic General Equilibrium Approach
Achieving the goals of price stability, sustainable economic growth, and the improvement of many economic variables require coordination between the monetary and financial authorities. In this study, a new modified Keynesian stochastic dynamic equilibrium general equilibrium model is introduced for Iran and in the framework of game theory, optimal policy of fiscal and monetary authorities are d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2018